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Abstract — In this paper we analyze the bound on the additive 
white Gaussian noise channel (AWGNC) pseudo-weight of a 
(c, d) -regular linear block code based on the two largest values 
Ai > A 2 of the eigenvalues of H T H: w™ in (H) ^ n|^||. (6). In 
particular, we analyze (c, d) -regular quasi-cyclic (QC) codes of 
length rL described by J x L block parity-check matrices with 
circulant block entries of size r xr. We proceed by showing how 
the problem of computing the eigenvalues of the rL x rL matrix 
H T H can be reduced to the problem of computing eigenvalues 
for r matrices of size L x L. We also give a necessary condition 
for the bound to be attained for a circulant matrix H and show 
a few classes of cyclic codes satisfying this criterion. 

Index Terms — Low-density parity-check codes, pseudo- 
codewords, pseudo-weights, eigenvalues, eigenvectors. 

I. Introduction 

Low-density parity-check (LDPC) codes offer excellent 
tradeoffs between performance and complexity for error cor- 
rection in communication systems. Quasi-cyclic (QC) LDPC 
codes in particular have proved extremely attractive due to 
their implementation advantages, both in encoding and decod- 
ing [1 1, [2 1, [3|. Many analyses of QC-LDPC codes have been 
carried out based on optimization of parameters such as the 
minimum Hamming distance of the code or the girth of the 
Tanner graph. However, it has been shown that an excellent 
first-order measure of performance over the AWGNC is the 
minimum pseudo-weight of the code [4|. So far, few results 
exist in the literature on the minimum pseudo-weight of QC- 
LDPC and related codes. 

Spectral graph analysis was used in [5 1, and more recently, 
in (6), to obtain bounds on the minimum Hamming weight, and 
minimum AWGNC pseudo-weight, respectively, of a length-n 
(c, <f)-regular code C over the binary field F2: 
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with Ai > • • • > A s being the distinct ordered eigenvalues 
of H T H G M™ x ™ (where H is viewed as a matrix in 
M. mxn ). These bounds are, for most codes, loose. However, 
in particular cases, like the projective geometry codes Q, 0, 
J9], they are attained. A current problem with these bounds is 
that for most LDPC codes, it is not practical to evaluate the 
eigenvalues Ai, A2 due to the size of the matrix H T H. 

In this paper we show how to compute the AWGN pseudo- 
weight lower bound for quasi-cyclic (QC) and related codes 
by utilizing the „4-submodule structure of quasi-cyclic codes, 



A = R[X}/(X r - 1) (TO), El, H2). In particular, we 
begin by showing how the polynomial parity-check matrix 
that describes a cyclic code can be used to compute the 
required eigenvalues, and then generalize this approach to 
compute the required eigenvalues for QC codes. We also 
define the class of "nested circulant" matrices, and show 
that these have eigenvalues which are given by evaluating a 
multivariate associated polynomial at points whose coordinates 
are particular roots of unity. Finally, we give a necessary 
condition for the pseudo-weight lower bound to be attained 
when H is circulant and show a few classes of cyclic codes 
satisfying this criterion. 

II. Basic Notation and Definitions 

All codes in this paper will be binary linear codes of 
a certain length n specified through a (scalar) parity-check 
matrix H = (hj t i) G F™*" as the set of all vectors ceF 2 " 
such that H • c T = T , where T denotes transposition. The 
minimum Hamming distance of a code C will be denoted by 
d m i n (C). The fundamental cone /C(H) of H is the set of all 
vectors u> G R™ that satisfy 



Wj > 



UJ, 



i'eX;(H)\i 



for alH G T(H) , (1) 
for all j 6 J{U), i GXj(H) , (2) 



where »7(H) and 1(H) denote the sets of row and column 
indices of H respectively, and X/(H) = {i G X \ hjj = 1} 
for each j G *7"(H). A vector u) G /C(H) is called a pseudo- 
codeword. The AWGNC pseudo-weight of a pseudo-codeword 



u> is defined to be w p (u)) 



„AWGNC 



(For a motivation of these definitions, see fl4l . lfT31l ). The 
minimum of the AWGNC pseudo-weight over all nonzero 
pseudo-codewords is called the minimum AWGNC pseudo- 
weight and is denoted by Wp lm (H). 

For any integer s > 1, let R s — {exp(t2nr / s) : < 
r < s} denote the set of complex s-th roots of unity, and let 
i?~ = The symbol * denotes complex conjugation. 

Also, an r x r circulant matrix B, whose entries are square 
L x L matrices, will be called an L-block circulant matrix; 
we shall denote this by 



B = circ(b , bi, 



l) 



where the (square L x L matrix) entries in the first column of 
B are bo, bi, ... , b r _i respectively. 



Finally, Z, K, C, and F2 will be the ring of integers, the field 
of real numbers, the complex field, and the finite field of size 2, 
respectively. For a positive integer L, [L] will denote the set of 
nonnegative integers smaller than L: [L] = {0, 1, . . . , L — 1}. 

III. Computing the Eigenvalues of H t H for a QC 
Code 

In this section we will show that the polynomial represen- 
tation of a QC code will prove very helpful in computing the 
eigenvalues of the large matrix H T H, easing in this way the 
computation of the lower bound 

2c- A 2 



(3) 



Ai — A2 

This section is organized in three subsections. In Sec. IIII-AI 
and IIII-BI we provide some background on circulant matrices 
and QC codes. Section IIII-CI will contain the main result on 
the eigenvalues of H T H, where H is the parity-check matrix 
of a QC code. 

A. Eigenvalues of a Circulant Matrix 

The eigenvalues of a square circulant matrix are well known 
Q6). If B G C nx ™ is a circulant matrix and w(X) = 
bo+biX+. . .+b n -iX n ~ 1 its (column) associated polynomial, 
then the eigenvalues of B are given by this polynomial's 
evaluation at the complex n-th roots of unity, i.e. w(x) for 
all x G R n . 

The following gives a proof of this result based on the 
polynomial representation of a circulant matrix. It may be seen 
as a special case of the method we present later for QC codes. 

Let A be an eigenvalue of B. Then there exists a nonzero 
vector v = (vq, . . . , v n -i) T G C" such that 

Bv = Av. 

In polynomial form, this equation is equivalent to (here 

v(X) =v +v 1 X + ... + ^-il"- 1 ): 

w(X)v(X) = Xv(X) mod (X n - 1) iff 
X n -1\ w(X)v(X) - Xv(X) in C iff 
w(x)v(x) — Xv(x),yx G R n iff 
(w(x) — X)v(x) = 0, Vx G R n ■ 



For each x G R n , X — w (x) is a solution of the above 
equation, and therefore it is an eigenvalue for the matrix B. 
There are n such solutions, therefore, these are all possible 
eigenvalues of B. 

In the next theorem we will consider an L-block circulant 
matrix instead of a circulant matrix. This theorem may be 
found in [17|; we provide here an alternative proof based on 
the polynomial representation. 

Theorem 1 Let B = circ(b , bi, • • • ,b r _i) G C rLxrL be 
an L-block circulant matrix. Let W(X) = bo + h\X + . . . + 
b r _iX r_1 its (column) associated matrix polynomial. Then 
the eigenvalues o/B are given by the union of the eigenvalues 
of the L x L matrices W(x), for all x G R r . 



Proof: The proof follows the reasoning in the theorem 
above. 

Let A be an eigenvalue of B. Then there exists a nonzero 
vector v = (vq, ■ ■ ■ , tVL-i) T G C rL such that 



Bv = Av. 



(4) 



Z L [X] given by p(X) = (wo,. 
) T X + ... + (u r(z 



Vl 



Let p(X) G 

(v L , V 2 L-l) T X + ... + (u r (L-l), • • ■ , VrL-l) T X 

polynomial form, equation is equivalent to: 
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In 



BpT)p(X) = Xp{X) mod (X r - 1) iff 
X r - 1 I B(X)p(X) - Xp(X) in C iff 
B(x)p(x) = Xp(x),Vx G R r - 

The last equation is the equation for the eigenvalues of the 
matrix B(x). Each such matrix has L eigenvalues, counting 
multiplicities, and there are r distinct complex numbers in R r \ 
this accounts for the total number rL of eigenvalues of B. The 
eigenvectors can also be deduced from the above. 

B. Definition and Properties of QC Codes 

A linear QC-LDPC code C QC = Cqc of length n = rL 
can be described by an rJ x rL (scalar) parity-check matrix 



H 



(r) _a 



q C — H that is formed by a J x L array of r x r circulant 
matrices. 



H 



Pi.i 
Pa,i 



Pl,2 
P2,2 



■j a 



P2,L 



(5) 



where the entries P^j are r x r circulant matrices. Clearly, 
by choosing these circulant matrices to be low-density, the 
parity-check matrix will also be low-density. 

With the help of the well-known isomorphism between the 
ring of r x r circulant matrices and the ring of polynomials 
modulo X r — 1, to each matrix Pjj we can associate a polyno- 
mial pij(X), and thus a QC-LDPC code can equivalently be 
described by a polynomial parity-check matrix P(X) of size 
J x L, with polynomial operations performed modulo X r — 1: 

PlA (X) p h2 (X) ... pu(A) 

P2,l(X) p 2 ,2{X) ... P 2X{X) 



P(X) 



P.j,i{X) P j,2(X) 



(6) 



By permuting the rows and columns of the scalar parity- 
check matrix H, 1 we obtain an equivalent parity-check matrix 
representation H for the QC code C, 



(r) 
QC' 



H 
Hi 

Hr 1 



H r _! 

Ho 

H r _9 



H/ 
H 2 

Ho 



(7) 



'i.e., by taking the first row in the first block of r rows, the first row in 
the second block of r rows, etc., then the second row in the first block, the 
second row in the second block, etc., and similarly for the columns. 



where Ho, Hi, . . . , H r 1 are scalar J x L matrices. The 
connection between the two representations is 

H + HiX + • ■ ■ + H^iX'- 1 = P{X). (8) 

C. The Eigenvalues of the Matrix H T ■ H of a QC Code 

Note that for a fixed value of r > 1, © provides a 
simple bijective correspondence between the set of polynomial 
matrices P(X) £ (R[X]/(X r - l)) JxL and the set of parity- 
check matrices of the form 0. Furthermore, the product of 
two such polynomial matrices, where defined, yields another 
which corresponds via this bijection with the product of the 
corresponding parity-check matrices in the form 01. Also 
note that transposition of a polynomial matrix in the form ([H} 
corresponds to transposition of the corresponding parity-check 
matrix in the form (0, under this bijection. 

It follows that H T • H is an L-block circulant matrix; apply- 
ing Theorem Q] to this matrix yields the following corollary. 

Corollary 2 The eigenvalues o/H T -H are given by the union 
of the eigenvalues of the L x L matrices P T (a;*) • P(x),for 
x £ R r . 

Proof: We apply Theorem Q] to the L-block circulant 
matrix H T • H = circ(b , bi, ■ • • , b r _i) £ C ixrL and form 
the matrix W(X) = b +b 1 X+. . .+b r ^ 1 X r - 1 . This is equal 
to the product of the two matrix polynomials of H T and H, 
which are Hj + Hj_ 1 X + - • ■ + HjX r - 1 = X r P T (l/X) and 
H + HiX + • • • + H r _iX r - 1 = P(X), respectively. There- 
fore W{X) = (X r P T (l/X))-P{X) and so the eigenvalues of 
H T • H are the eigenvalues of P T (l/x) • P(x), for all x £ R r \ 
these are then equal to the eigenvalues of P T (a;*) • P(x), for 
all x € Rr (as x* — 1/x for all such x). 

Example 3 Let r = 31 and consider the (3, 5)-regular QC- 
LDPC code given by the scalar 93 x 155 matrix 2 



H 



The polynomial parity-check matrix P(X) £ (R[X]/(X r - 



II 


I 2 


II 


Is 


Il6 


I 5 


Iio 


I20 


l 9 


lis 


I 25 


Il9 


It 


Il4 


las 



1)) 



3x5 



IS 



P(X) 



X 
X 5 
X 25 



X 2 

X 10 
x w 



X 4 

X 7 



X 8 
X 9 

X 1A 



X 16 ' 
x w 

X 28 



This code is the famous (3, 5)-regular QC-LDPC code of 
length 155 presented in lfl8l . Note that the code parameters 
are [155, 64, 20]. The corresponding matrix H in the form (0 
is a 31 x 31 matrix with block entries H;, i £ [31] obtained 
by decomposing P(X) according to the powers of X: 



P(X) = H + HiX 



H 30 X 



.",0 



(9) 



Obviously only 15 matrices among the H; are nonzero, and 
all of these contain only one 1, the other entries being zero. 

2 Here Ig denotes the 31 X 31 identity matrix with rows shifted cyclically 
to the left by I positions. 



The matrix H T • H is a 5-block circulant matrix. Corollary 
12 above tells us that in order to compute its eigenvalues, we 
need to form the matrices P T (p~ l ) ■ P(p l ), for all i £ [31] 
(here p denotes a primitive complex 31-th root of unity). We 
have that 



P T (l/x) = 



and 





~x 30 


x 29 


x 27 


x 


23 


x 15 ' 




x 2e 


x 21 


x 11 


x 


22 


x 13 




X 6 


x 12 


x 2i 


x 


17 


x 3 






"3 


a 


e* 


C 


e* 






a* 


3 


b 


a* 


d 


P(x) = 


e 


6* 


3 


c 


b* 






c* 


a 


c* 


3 


d 






e 


d* 


b 


d* 


3 



for all x £ R31, where 

„5 , J*. b = 

x° + x a + x l4 ; e = x lu + x 1 " + x 



a = x + x' J + x^';b = x 2 + x 10 + x 19 ; c = x A + x 7 + x 

£ — „8 1 ^9 1 ^14 „16 1 „18 1 ^28 



2(1. 



Obviously for i £ [31], each matrix P T (p~ l ) • P(p l ) is 
Hermitian (in fact nonnegative definite), hence each has 5 
real nonnegative eigenvalues, giving a total of 31 • 5 = 155 
nonnegative eigenvalues for H T • H. 

We obtain that for each i £ [31], i ^ 0, the associated 
polynomial of P T [p~ l ) -P(p l ) may be written as (using p 31 = 
1) 

u(X) = X 2 (A 3 - 15A 2 + 62A - 62) 
= A 2 (A-A 2 )(A-A 3 )(A-A 4 ) 

where A 2 = 8.6801, A 3 = 4.8459 and A 4 = 1.4740. Also, for 
i = the associated polynomial of P T (p~ l ) • P{p l ) may be 
written as u(X) = A 4 (A — Ai) where Ai = 15. This yields 
the nonzero eigenvalues of H T • H as {Ai, A2, A3, A4} with 
multiplicities 1, 30, 30 and 30 respectively. □ 

IV. Eigenvalues of Nested Circulant Matrices 

In this section we define the class of nested circulant 
matrices, and show that they have eigenvalues which are given 
by evaluating a multivariate associated polynomial at points 
whose coordinates are particular roots of unity. 

Theorem 4 Let B = circ(b , bi, • • ■ ,b r _i) £ C rLxrL be 
an L-block circulant matrix. Suppose that each subblock 
b^ i £ [r], is also circulant, with associated polynomial 
p^\X) = ^2j = q bi.jX J . Define the associated polynomial 
ofBby 



q(X,Y) 



r-l L-l 
i=Q j=Q 



Then the set of eigenvalues of B is given by 
{q(x,y) : x £ R r ,y £ R L } . 

Proof: For each j £ [L] define = Y%=o Ki xi - 

By Theorem the eigenvalues of B are equal to those of the 



matrices given by W(x) for x G R r ; each of these is circulant 
with associated polynomial (in Y) given by 

L-l 

J2u (j) (x)Y j = q(x,Y) . 

3=0 

Thus the eigenvalues of each "W[x) are equal to q(x,y) for 
y G Rl, and the result follows. 

We next define what is meant by a nested circulant matrix. 



Definition 5 Let m > 1 and let it be a positive integer for 
each t = 1, 2, • • • , m. Also let B = circ(t>o, bi, • • • , b^-i) 
be a block-circulant matrix such that for every t = 
1,2,- ,m- 1, j t G [i t ] 

circ(bj 1)J:2) ... ,j' t) 0i bjjja,--' ,Jt,l' ' ' ' ■ kju'a,"- ,jt,it+l — i) 

is a/so block-circulant, and that bj lt j 2t ... Jm = bj lt j 2} ... Jm are 
scalars. Then B /s sa/a" fo fee an m-nested circulant matrix 
(with dimension n — YltLi H)- The associated polynomial of 
B is defined by 

41—1*2 — 1 irn— 1 W 

g(X 1 ,X 2l • • • , Af ro ) = EE"-E fyiJa,--- j m II *f 
ii=oj2=o j m =o t=i 

(10) 
□ 

Note that the 1-nested circulants are precisely the circulant 
matrices, and that the 2-nested circulants are precisely the i^- 
block-circulant matrices with circulant subblocks. Also note 
that the associated polynomial q{X\,X2, • • • , X m ) provides 
a succinct description of the matrix B. 

A straightforward generalization of Theorem[4]is as follows. 



Theorem 6 Let B be an m-nested circulant matrix with as- 
sociated polynomial q(Xi, X2, ■ ■ • , X m ) given by ( 17 OP above. 
Then the set of eigenvalues of B is given by 

{q(x\,x 2 , ■■■ ,x m ) : Xt G R tt V< = 1, 2, • • ■ , m} 

Proof: The proof uses induction, and follows the lines of 
the proof of Theorem [4] in a rather straightforward manner. 

Example 7 Here we take an example of an 3-nested circulant 
(i.e. to = 3), where i t = 2 for t = 1, 2, 3. The eigenvalues of 

"0 1 1 1 1" 

1 1 1 1 

1 1 1 1 

10 1110 

1110 10 
10 1110 

1 1 1 1 
1 1 1 1 



are equal to the eigenvalues of 



B' = 






1 + x 


X 


x 


1 + x 





X 


x 


X 


x 





1 + 


X 


X 


1 + x 






for 16 {-1.1}, which are equal to the eigenvalues of 

„ _ xy 1 + x + xy 

1 + x + xy xy 

for x G { — 1, 1} and y G { — 1, 1}- Finally, these are equal to 
the set 

{q(x,y,z) : x,y,z G {-1, 1}} 

where the associated polynomial of B is q(x,y,z) = xy + 
z(l+x+xy). In this example fro, 0,0 = 0, &o,o,i = 1> ^0,1,0 = 0, 
&0,i,i = 0, 61,0,0 = 0, 61,0,1 = 1, 614,0 = 1, 614,1 = 1; these 
may be easily obtained by matching the elements of the first 
column of B with the binary expansion of the corresponding 
row position. 

This example may be generalized to the case where n = 2 m 
and the circulant is m-nested; the eigenvalues are real. Note 
that the choice of the first column in B determines which terms 
in {l,x,y,z,xy,yz,zx,xyz} are included in the associated 
polynomial, and hence controls the eigenvalues of B. □ 

Theorem 8 If H is an m-nested circulant matrix, then B = 
H T H is an m-nested circulant matrix. 

Proof: It is straightforward to prove the stronger result 
that if A and B are TO-nested circulants with specified nested 
dimensions, then A T B is also m-nested circulant, with the 
same nested dimensions. The proof proceeds by induction on 
m. The base case m = 1 is straightforward. Next, let A be 
block-circulant with block entries in the first column equal 
to some (m — 1) -nested circulants Aj, and let B be block- 
circulant with block entries in the first column equal to some 
(m— l)-nested circulants Bj. The matrix A T B is then block- 
circulant, and each block entry is a sum of matrices of the form 
AjBj. By the principle of induction, each of these matrices 
is an (m — 1) -nested circulant, and it is easy to show that a 
sum of i-nested circulants (of the same nested dimensions) is 
another i-nested circulant (with these nested dimensions). 

V. Conditions for the Pseudo-Weight Lower 
Bound to Hold with Equality 

It is straightforward to show that a necessary condition for 
the bound of ifPil to hold with equality is that the eigenvalues 
of B = H T H G R nxn are Ai with multiplicity 1 and A 2 < A x 
with multiplicity n — 1. 

If H is circulant with (row) associated polynomial w(X) 
of degree k < n, the eigenvalues of B are precisely 
{|u>(a;)| 2 : x G R n }', therefore the largest eigenvalue of 
B is Ai = |w(l)| 2 = d 2 where d is the number of nonzero 
coefficients in w(X) (noting that |w(l)| 2 > |w(x)| 2 for all 
x G Rn)' Let w{X) = X k w(l/X) denote the reciprocal 
polynomial of w(X) which is obtained by reversing the order 



of coefficients in w(X). Now assume that the bound of |fl3l 
holds with equality. Then we must have 

|ui(x)| 2 = w(x)w*(x) — A2 Vi £ R~ 

for some positive real number A2, i.e. 

w(x)w(\/ x) = A2 Vie R~ . 

This is equivalent to 

w(x)w(x) = \2X k Vie R~ 

Thus R~ is a subset of the roots of the polynomial 

w{X)w{X) - X 2 X k , and so 

w(X)w{X)-X 2 X k = (l + X + X 2 + --- + X n - 1 )r(X) (11) 

where r(X) is a polynomial of degree 2fc — n+l>0 with 
integer coefficients. In the following we give details of this 
condition for some codes which attain the bound of [ 1 3 1 with 
equality. 

Example 9 The EG(2, 2) code with q = 2, n = 3, k = 1, 
d = 2 has w(X) = 1 + X. Here A x = d 2 = 4 and (Q3) holds 
in the form 



(1 + *) 



X = 1 + X + I' 



so in this case A2 = 1 and r(X) = 1. Here 



rfmin=< m (H)=n 



2d - A; 
d 2 - A, 



=3= g +l 



□ 



Example 10 The PG(2, 2) code with q = 2, n = 7, fc = 3, 
d = 3 has = 1 + X + X 3 . Here Ai = d 2 = 9 and CCD 

holds in the form 



(1 + X + X 3 ){1 + X 2 + X a ) - 2X 3 = 1 + X 
so in this case A2 = 2 and r(X) = 1. Here 



X t 



d min = W f n (H)=n 



2d- A 5 
d 2 - X, 



=4= g +2 



□ 



Example 11 The PG(2,4) code with q = 2, n = 21, A; = 11, 
d = 5 has = 1 + X 2 + X 7 + X 8 + X 11 . Here Ai = 

d 2 = 25 and (fTTb holds in the form 

(1 + X 2 + X 7 + X 8 + X u )(l + X 3 + X 4 + X 9 + X 11 ) 
-4X 11 = (1 + X + X 2 + • • • + X 20 )(1 - X + X 2 ) 

so in this case A2 = 4 and r(X) = 1 — X + X 2 . Here 

'2d - A 2 S 



d min =< Mn (H) 



d 2 -A 2 



6 = 9 + 2 



□ 

Note that for a general PG(2, q) code, for the bound to hold 
with equality we require 

<""(H) = 9+1 = n'' M ~ V 



d 2 - A; 



(? 2 + 9+l) 



2(g+l) - A 2 
(9 + l) 2 -A 2 



and therefore we must have A2 = 9. Also, for a general 
EG(2, 9) code, for the bound to hold with equality we require 



W - in (H)=9 + l 



2d - A 2 
d 2 -A 2 

29- A 2 



1 



9 2 -A 2 



and therefore we must have A 2 = 9 if 9 > 2, whereas for 
9 = 2, any A2 will achieve the bound. 

VI. Conclusions and Future Work 

A method has been presented for evaluation of the 
eigenvalue-based lower bound on the AWGNC pseudo-weight 
based on spectral analysis, for QC and related codes. It was 
shown that the relevant eigenvalues may be found by com- 
puting the eigenvalues of a certain number of small matrices. 
We also presented a necessary condition for the bound to be 
attained with equality and gave a few examples of codes for 
which this happens. Future work involves optimization of QC 
code designs based on these bounds. 
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